This commit fixes some of the issues with ArrayMesh, Occluder3D and NavigationMesh baking. Basically, a few places scale the wrong thing, giving the output the appearance of having been scaled twice.

Unfortunately there still seems to be some kind of issue specifically with navmesh baking that I don't have time to look into at the moment. It could be another navmesh-related engine issue, because baking other kinds of meshes shows no issues here.

I've only briefly looked at the effect of vertex spacing on slope sculpting. It appears to be "spiky" whenever vertex spacing is below or above 1.

Thank you, I have added the fix for the arraymesh/occlusion/navigation generation. I also simplified the scaling code.

I generated a section and it seems fine. Note that with 3x mesh scaling, the total size of the navigation mesh increases 3x. There is a finite limit on the size of what can be generated, so I painted a much smaller navigable section and it generated fine. I've never tried any AABB nav mesh generation so don't know what is working properly or not.

I also fixed the last row of collision and am looking at the dithered brushing now.

I fixed the dithered brush and slope sculpting heights. The only remaining things are: AABB, and reviewing the code.

@tcoxon Edited aabb is wrong in the main tree. Flattening the demo mountain peak w/ vertex scaling:

• @ 1 Terrain3DStorage::add_edited_area: [P: (513.7451, 336.2854, 613.7875), S: (50, 26.30222, 50)]
• @ 2 Terrain3DStorage::add_edited_area: [P: (521.157, 339.005, 623.036), S: (50, 26.07883, 50)]
• @ 0.5 Terrain3DStorage::add_edited_area: [P: (509.7927, 335.5546, 604.967), S: (50, 26.65845, 50)]

This pr:

• @ 1 Terrain3DStorage::add_edited_area: [P: (511.0797, 333.2357, 614.1357), S: (50, 31.5379, 50)]
• @ 2 Terrain3DStorage::add_edited_area: [P: (1058.114, 355.972, 1258.456), S: (50, 9.005615, 50)]
• @ 0.5 Terrain3DStorage::add_edited_area: [P: (241.0488, 284.7164, 292.0633), S: (50, 80.21317, 50)]

That scaling looks right to me. I think this PR is now done.

@tcoxon I'm going to merge this in so we can get more people using and testing. If there's a specific problem with edited_area we can follow up in another issue. Hopefully before I release 0.9.1, but I want to release it soon. Maybe today.